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Abstract —In this paper we prove threshold saturation for spa¬ 
tially coupled turho codes (SC-TCs) and braided convolutional 
codes (BCCs) over the binary erasure channel. We introduce a 
compact graph representation for the ensembles of SC-TC and 
BCC codes which simplifies their description and the analysis 
of the message passing decoding. We demonstrate that by few 
assumptions in the ensembles of these codes, it is possible to 
rewrite their vector recursions in a form which places these 
ensembles under the category of scalar admissible systems. 
This allows us to define potential functions and prove threshold 
saturation using the proof technique introduced by Yedia et al.. 

1. Introduction 

Low-density parity-check (LDPC) convolutional codes 0^ 
also known as spatially coupled LDPC (SC-LDPC) codes 
Q have received a great deal of attention in the recent 
years as a result of their excellent performance under iterative 
decoding. In particular, it has been shown that the threshold of 
a belief propagation (BP) decoder improves to the threshold 
of an optimal maximum a-posteriori (MAP) decoder. This 
remarkable phenomenon is called threshold saturation. 

Spatial coupling is not limited to LDPC codes. Braided 
convolutional codes (BCCs) are a class of spatially coupled 
(SC) codes introduced in 0- Recently, the authors intro¬ 
duced spatially coupled turbo codes (SC-TCs) Q, as the 
SC counterparts of parallel Q and serially ||^ concatenated 
convolutional codes. In Q, 0-|j9|, we investigated threshold 
saturation for SC parallel concatenated codes (SC-PCCs), 
SC serially concatenated codes (SC-SCCs) and BCCs over 
the binary erasure channel (BEC). We derived closed-form 
density evolution (DE) equations for SC-TCs and BCCs and 
investigated their decoding thresholds. Our numerical results 
suggest that threshold saturation occurs for SC-PCCs, SC- 
SCCs and BCCs. 

In this paper, we formally prove threshold saturation for SC- 
TCs and BCCs over the BEC. Our proof relies on the proof 
technique based on potential functions, recently proposed 
by Yedia et al. jTO), |TT). We introduce a compact graph 
representation to describe PCC, SCC and BCC ensembles. 
Similar to a protograph fT^ , the compact graph makes it easier 
to illustrate the analysis of the message passing decoding. We 
then demonstrate that by few assumptions, the DE recursions 
of SC-TCs Q, and BCCs Q, can be rewritten in a 
form that corresponds to the recursion of a scalar admissible 


system as in |10|. This makes it possible to derive suitable 
potential functions for TCs and uncoupled BCCs. Einally, we 
prove threshold saturation for SC-TCs and BCCs following 
the same lines as the proof in p0[ for SC-LDPC codes. 


11. Compact Graph Representation 

It is possible to analyze message passing decoding al¬ 
gorithms in an efficient way by the use of factor graphs 
GD- However the conventional factor graph of codes with 
convolutional component codes, such as PCCs, SCCs and 
BCCs, gets very large as the length of the component codes 
increases. In this section we introduce a more compact graph 
representation, in which each trellis is represented by a single 
factor node and each collection of variables of the same type 
is represented by a single variable node. We use this compact 
graph representation to obtain DE equations and describe the 
spatially coupled ensembles. 

Fig. 0 a) shows the conventional factor graph representation 
of a rate R — 1/3 PCC. This code is built from two rate-1/2 
recursive systematic encoders, referred to as upper and lower 
encoders; we call the corresponding trellises upper and lower 
trellises and denote them by Tu and Tl, respectively. The 
information sequence at time slot t is denoted by Ut and is 
a vector of N bits Ut = {ui,U 2 , ■ ■ ■ ,un). The information 
sequence Ut and its reordered copy are encoded by the upper 
and lower encoder to produce parity sequences v]/ and v/, 
respectively. 

Fig. [^&) shows the compact graph representation of this 
code. Each of the sequences Ut, v]/ and v/ are represented 
by a single black circle (variable node). Thus, each variable 
node in the compact graph corresponds to a number of 
code symbols. The trellises are replaced by squares (factor 
nodes) which are labeled by their lengtlj^ The permutation is 
represented by a line that crosses the edge which connects Ut 
to Tl in order to emphasize that a reordered copy of Ut is used 
in Tl. The transmitted code sequence is i; = {ut,v]/,v/). 

Fig. 0 c) depicts the compact graph representation of a 
rate i? = 1/4 SCC built from two rate-1/2 recursive sys¬ 
tematic convolutional encoders, referred to as inner and outer 
encoders. We call the corresponding trellises inner and outer 
trellises and denote them by Tj and Tq, respectively. At time 
t, the information sequence Ut, of length N, is encoded by 
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^The length of a trellis is equal to the length of each of the sequences 
which are connected to that trellis. 





Fig. 1. (a) Conventional factor graph of a PCC, compact graph of a (b) PCC, 
(c) see, (d) BCC. 

the outer encoder to produce the parity sequence vf. Then, Ut 
and vf are multiplexed and reordered to create a sequence vf 
whose length is 2N. The sequence vf is encoded by the inner 
encoder to produce the parity sequence vj. The transmitted 
code sequence is rt = {ut,vf ,vl). 

BCCs consist of two rate-2/3 component convolutional 
encoders. As for PCCs, we call the component encoders upper 
and lower and the corresponding trellises as upper and lower 
trellises and denote them by Tu and Tl, respectively. BCCs are 
inherently SC but we can define uncoupled BCCs by tailbiting 
a chain of a coupled code with coupling length L = 1. 
Fig. [^d) shows the compact graph of uncoupled BCCs. At 
time t, the parity sequences of Tu and Tu are denoted by 
and respectively. The information sequence Ut and a 
reordered copy of rtj' are used in Tu to produce . Likewise, 
some reordered copies of Ut and v]^ are used in Tu to produce 
v]^. The transmitted code sequence is t; = (ttj,rtj'). 


III. Density Evolution and Scalar Admissible 
System 

In this section, we first define a scalar admissible system. 
Then we show that by few assumptions in the ensembles of 
TCs and BCCs, it is possible to rewrite their DE recursions in a 
form which corresponds to the recursion of a scalar admissible 
system. 

Definition 1 ( A scalar admissible system {f,g), is 

defined by the recursion 

( 1 ) 

where / : [0,1] x [0,1] —)■ [0,1] and g : [0,1] —>■ [0,1] satisfy 
the following conditions. 

• / is increasing in both arguments a;,e G (0,1]; 

• g is increasing in a; G (0,1]; 

. /(0;e) = /(x;0)=5(0)=0; 

• / and g have continuous second derivatives. 


A. Parallel Concatenated Codes 

Consider the PCC in Pig. 0^)- To formulate the DE 
equations as we obtained in Ej, let and p^\ denote 
the extrinsic erasure probabilities to Ut from Tu and Tu, 
respectively. Consider transmission over the BEC with erasure 
probability e. The erasure probabilities to Tu from Ut and v]^. 


in the ith iteration, are s-p^^ and s, respectively. Thus the 
DE update for Tu is given by 


where 


Pl],s ~ Ju,s ) £ J ) 

(2) 

(i-1) (i-1) 

9l = e • Pl,s 

(3) 


and /u,s denotes the transfer function of Tu for the informa¬ 
tion bits. Similarly, the DE update for Tu can be written as 


where 


Ji) _ f 

Ph,s ~ /L,s ^^9u ) 


(i-l) (i-l) 

Qu -^■Pu,s ■ 


(4) 

(5) 


The DE equations for PCCs in (|^-(|^ involve different edges 
and hence form a vector recursion. However, considering 
identical Tu and Tu nodes (i.e., identical component encoders), 
it follows that /u,s = /l.s = /s- Therefore, 

Now, using this and by substituting ([^ into 0 and into 
Q, the DE can be written as a scalar recursion, 

(6) 


where the initial condition is = 1. Consider /(x;e) = 
fs{£ ■ X, e) and g{x) = x. We show in the following that these 
two functions meet the conditions in Definition [T] Therefore, 
the recursion Q is a recursion of a scalar admissible system. 
The function g{x) = x is a simple function and it is easy to 
show that it satisfies all conditions in Definition[^ /(x; e) is a 
transfer function of a BCJR decoder with a-priori information 
X and channel erasure probability e. In the following lemma 
we show that it satisfies the conditions in Definition [T] 

Lemma 1: Consider a terminated convolutional code where 
all distinct input sequences have distinct coded sequences. Por 
such a system, the transfer function /(x; e) of a BCJR decoder 
with a-priori probability x and channel erasure probability e, 
or any convex combination of such transfer functions, satisfies 
all conditions in Definition [T] 

Proof: The BCJR decoder is an optimal APP decoder. 
Consider two BECs with erasure probabilities £i and £ 2 , with 
£i < £ 2 - The BEC with erasure rate £ 2 , can be seen as 
the concatenation of two BECs with erasure rates £i and 
£', where e' = 1 — yEff- The data processing inequality 
implies that /(x;ei) < /(x;e 2 )- This means that the erasure 
probability at the output of the BCJR decoder is monotone 
and increases with e. When e = 0, the input sequence can be 
recovered perfectly from the received sequence, as there is a 
one-to-one mapping of input sequences to coded sequences. 
This means /(x; 0) = 0. It is also possible to proof that 
/(xi;e) < /(x 2 ;e) for Xi < X 2 (not shown due to lack of 
space). 

Pinally, /(x;£) is a rational function and its poles are 
outside the interval x, e G [0,1] (otherwise we may get 
infinite output erasure probability for a finite input erasure 
probability), so it has continuous first and second derivatives 
in the interval x, e G [0,1]. ■ 




















B. Serially Concatenated Codes 

Consider the SCC in Fig. j^c). We define by the ex¬ 
trinsic erasure probability from Tj to Ut and v9. Likewise, let 

fi) (i) 

Pq g and Pq p denote the extrinsic erasure probabilities from 
To to Ut and in the ith iteration, respectively. Consider 
the transmission over the EEC with erasure probability e. The 
erasure probabilities from Ut and to To in the ith iteration 
both are equal to 


(i-i) (i-i) 

-^-pL ■ 


Thus, the DE equations for To can be written as 




Po,p — 


/o,p (^Qi 1 9i 


(*-i) (i-i) 


(7) 

(8) 

(9) 


(*) 

W Po.s 
To - 


(t) 

■7'o.p 


( 10 ) 


Let /i s denote the transfer function of Ti for the input bits. 
The DE equations for To can be written as 


= fl,s (^o^s) ■ 


( 11 ) 


=e - f,(eg{x^"^),ey 


( 12 ) 


where 


5(a;0)) = 




(13) 


and the initial condition is cc*-®! = 1. 
Consider f{x; e) = e ■ fs{x, e) and 


9{x) = 


Mx,x) + fp{x,x) 


According to Lemma these two functions meet the condi¬ 
tions in Definition [T] and we can conclude that the DE recursion 
of SCCs in ([T2]i is a recursion of a scalar admissible system. 


C. Braided Convolutional Codes 

Consider the BCC in Eig. j^d). Let p^^^, and k = 
1, 2, 3, denote the extrinsic erasure probabilities from Tu and 
Tl in the ith iteration, through their fcth connected edge, 
respectively. The exact DE equations can be written as Q 


Pup =/u.i (■ 

Pu.2 =/u.2 (e 


(i—1) (*—1) (t—1) 

^•Pl.1 -£^-Pl, 3 .e-Pl2 


(i—1) (i—1) 

•Pl.1 L^-Pl,3 


(i-1) 

Pl.2 


(i) f ( (j-1) (i-1) (i-l)\ 

Pu.a =/u.3 • Pl. 1 Le-PL,3 .£-<2 ) 


(14) 

(15) 

(16) 


where fo,s and /o,p denote the transfer functions of To for 
the input and parity bits, respectively. 

The input sequence of the inner encoder consists of Ut 
and v9, so that the erasure probability that comes to Tq 
through the set of these two variable nodes is the average of 
the extrinsic erasure probabilities from Ut and vf, i.e.. 


where /u,fc denotes the transfer function of Tu for the fcth 

connected edge. Likewise, the DE equations for Tp can be 

(i) (i) 

written by swapping p// and p^ ^ for fc = 1, 2,3. 

Similarly to PCCs and SCCs, the DE equations of a BCC 
form a vector recursion. In order to modify this recursion to 
scalar form, in the first step consider identical upper and lower 
factor nodes. It follows /up = /up = fk and p[j*^ = p[j*^ = 
Xk for k = 1,2,3. Then we can rewrite the DE equations of 
Tu as 


Xi 

= /i| 

(i) 

(0 (*)^ 

, t U.3 , t <1^2 j 

( 17 ) 

^2 

= /2| 

< (i) 

• 2^1 

(0 (^)^ 
C.O’^' C.O’'''' I 

, t t d.2 j 

( 18 ) 

*^3 

= / 3 ( 

t (i) 

£•2^1 

(0 (OA 

, c 0/3 , c ^2 1 . 

( 19 ) 


Equations (0 to (111 show that the DE for SCCs in Eig. [T] 
(c) is a vector recursion. However, for identical Tq and Tj, it 
follows /i,s = /o.s = /s and /i,p = /o.p = /p. Using this 
and and = a;(*\ by substituting (18 ])-([TT]i into (0, the 

DE recursion can be written as 


According to the above equations, the DE recursion is still in 
vector form. To rewrite it in scalar form, one alternative is 
to consider identical component encoders with a time-varying 
trellis, such that all three transfer functions are equal. Eor 
example, by periodically changing the order of symbols along 
trellis branches, this function becomes the average of the 
transfer functions fi, f 2 , fs, /ave = h+h+fa _ gy above 
assumption, xi = X 2 = x^ = x. Using this in ([T7|)-([T^ we 
can simplify the DE recursion as 

— f 

— J as 




( 20 ) 


Considering f{x;e) = /ave(£ ■ x,e ■ x,e ■ x), g{x) = x and 
Lemma is the recursion of a scalar admissible system. 

IV. Single System Potential 
Since the DE recursion of TCs and BCCs can be written as 
the recursion of a scalar admissible system, we can derive the 


coiTesponding potential functions 110|. 

Definition 2: For a scalar admissible system, the potential 
function U{x;e) is defined by 


U{x;e)=[ {z-f{g{x);e))g'{z)dz 
Jo 

= xg(x) - G{x) - F{g{x); s), 


( 21 ) 


where F{x]£) = f{z;£)dz and G{x) = fg g(z)dz. 

Proposition 1: The potential function has the following 
characteristics. 

• U{x; e) is strictly decreasing in e S (0,1]. 

• An X € [0,1] is a fixed point of the recursion 0 iff it is 
a stationary point of the potential function. 









Fig. 2. The potential function of PCC with generator matrix G = (1, 5/7) 
in octal notation 


Definition 3: If the DE recursion is the recursion of a BP 
decoder, the BP threshold is m 

= sup |e S [0, l]\U'{x-, e) > 0, Vx S (0,1]|. 

According to Definition for e < the potential function 
has no stationary point and its derivative is always larger than 
zero for x G (0,1]. 

Definition 4: For e > e®*”, the minimum unstable fixed 
point is u{e) = sup{x G [0, l]|/(g(x); e) < x,x G (0,x)}. 
Then, the potential threshold is m 

e* = sup |e G [0, l]|u(x) > 0, min 17(x;e)>o|. 

The potential threshold depends on functions g{x) and /(x; e). 
Since at least one of these functions depends on the component 
encoders, e* also depends on the component encoders. 

Example 1: Consider a rate-1/3 PCC in Fig.[2a) with iden¬ 
tical component encoders with generator matrix G = (1,5/7) 
in octal notation. Its potential function is 

x2 

U (x; e) = x^ - G'(x) - Fs(x; e) = y - F^{x; e), 

where Fs{x;e) = /g^/s(e- z,e)dz and G(x) = g(z)dz = 

2 • 

The potential function of this code is shown in Fig. As it 
is illustrated in the figure, e = 0.6428 is the maximum channel 
erasure probability for which the derivative of the potential 
function is greater than zero and the potential function has 
no stationary point for x G (0,1]. Thus, £ = 0.6428 is the 
BP threshold of this code (see Definition [^. The potential 
threshold is e* = 0.6554 (see the black line in Fig. |^. These 
results match with our numerical results in Q. 


V. Coupled system and Threshold Saturation 
Theorem 1: Consider a spatially coupled system defined by 
the following recursion at time t. 




1 + 


-771 - m 


( 22 ) 


fc =0 


1=0 


For a large enough coupling memory and £ < £*, the only 
fixed point of the recursion is x = 0. 



(a) (b) (c) 


Fig. 3. Compact graph of (a) SC-PCCs, (b) SC-SCCs, (c) BCCs 


Proof: The proof follows from 110|. ■ 

In the following we demonstrate that the recursion of SC- 
PCCs, SC-SCCs and BCCs correspond to the recursion in (22i. 


A. Spatially Coupled Parallel Concatenated Codes 

Fig. [^a) shows the compact graph of SC-PCCs at time t 
for coupling memory m. The sequence corresponding to the 
input variable node at this time, tt*, is divided into m -I- 1 
sequences, Utj, j = 0,..., to. At time t, the sequences Ut-jj, 
j = 0,..., TO are multiplexed and reordered. The resulting 
sequence is used as the input to Ty at time t. Likewise, a 
reordered copy of the sequence corresponding to the input 
variable node at the current time slot, is divided into m + 
1 sequences j' = At time t, the sequences 

f = 0,...,TO are multiplexed and reordered. The 
resulting sequence is used as the input to Tl at time t. In 
other words, Ut is connected to the set of Tus and the set 
of TlS at time slots t to t + m. Consider identical Tus and 
TlS. Due to the symmetric coupling structure, both erasure 
probabilities that come to itj at time t are equal and denoted 
by X(*^. Following the compact graph of SC-PCCs, the erasure 
probability to Ty through its first edge is the average of the 
erasure probabilities from Ut', t' = t — m,... ,t. Therefore, 
the update of Tu and Tl at time t is 



£ 

TO -I- 1 


m 



j=0 


where /s * is the transfer function of Tu and Tl at time t 
for the information bits. The erasure probability that comes to 
Ut at time slot t through each of the incoming edges is the 
average of the erasure probabilities that come from the set of 
Tus or TlS at time slots / to / -I- to. The recursion equation at 
time slot t can then be written as 


, 6 + 1 ) 


TO 


m 

^ ^ fs,t+k ^ 


k=0 


m + I 


j=0 


j+k 


,e). 


(23) 


The recursion ( |23| l is identical to the recursion in ( |2^ . Thus, 
according to Theorem [T] for channels with erasure probability 
£ < £*, the only fixed point of recursion (|2^ is zero. 
















































B. Spatially Coupled Serially Concatenated Codes 

Fig. I^b) shows the compact graph of SC-SCCs at time 
t for coupling memory m. Similarly to uncoupled SCCs, at 
time t, Ut and are multiplexed and reordered to produce 
the sequence {1°. ii® is randomly divided into m + l sequences 


j = 0, 


, TO. Ti at time t receives a sequence which is 


built from sequences j, j = 0,..., m, and reordered. 

Consider identical Tq and Ti and denote the erasure prob¬ 
ability from Ti to the set of Ut and by xj at time t and 
iteration i. Then, the message from this set to the set of Tjs is 


where g(x) is obtained in (131. Following the edges 


which are connected to Ti at time t, the erasure probability 
that Ti receives through its first edge is 


TO + 1 




j=0 


The update of Ti can be written as 

e 






where /s t is the transfer function of Ti and To at time t for 
their input bits. 

Both Ut and receive equal erasure probabilities from 
the set of Tis. This erasure probability is the average of the 
erasure probabilities from Tj at time slots f to f + to. The DE 
recursion can then be written as 




1 + m ^ 
k=0 


^ ' fs,t+k { 
\1 


J29i4-j+k 

3=0 




where function g is given in ( [T3] l. This recursion is identical 
to the recursion in ( |22] i. Therefore, we can conclude that for 
e < e* the only fixed point of the recursion of SC-SCCs is 
zero and threshold saturation occurs. 


C. Braided Convolutional Codes 

Fig. I^c) shows the compact graph of BCCs at time t 
for coupling memory to. This ensemble of BCCs is slightly 
different from the ensembles we introduced in Q. To couple 
the code with memory to, each of the sequences corresponding 
to lit, a reordered copy of the information sequence, Ut, v]^ 
and Vt is divided into to -|- 1 sequences and denoted by Utj, 
Ut,j, v^j and for j = 0, ...,to, respectively. At time 
t, sequences Ut-jj for, j = 0,..., to, are multiplexed and 
reordered. The resulting sequence is used as the first input 
to Ty. Likewise, the sequences ^ for j — 0,... ,m, are 
multiplexed and reordered. The resulting sequence is used as 
the second input of Ty. The sequences Utj for j = 0,..., to, 
are multiplexed and reordered and used as the first input of 
Tl. Likewise, the sequences j for j = 0,...,to, are 
multiplexed and reordered and the resulting sequence is used 
as second input of Tl. 

Consider identical component encoders at time t. The 
erasure probabilities to Ut, and v]3 are equal due to the 
symmetric coupling structure and denoted by x[''\ Following 


the compact graph, the erasure probabilities to Ty through all 
its incoming edges are equal and are given by the average 
of the erasure probabilities from Ut'S, t' = t — m,... ,t, 
j ■ Thus, the erasure probabilities from 
each of the factor nodes to their outgoing edges are equal to 
/ave,t(gt, gt, where /ave.t IS the transfer function of Ty and 
Tl at time t for all edges. Finally the recursion at time slot t 
is 


„F+i) 


1 


1 -I- TO 


^ fa.\s.t+k{Qt+kT Qt+kj Qt+k) ■ (24) 


fc=0 


As (241 is identical to ( [22| , according to Theorem [T] for 
channels with erasure probability e < e*, the only fixed point 
of (p4)l is equal to zero. 


VI. Conclusions 

We considered three families of spatially-coupled turbo¬ 
like codes with identical component encoders whose density 
evolution recursions can be analyzed using the coupled scalar 
recursion framework of Hi- Then, based on this framework, 
we proved threshold saturation for these code ensembles 
over the BEC. Eor a more general case (different component 
encoders), the analysis is significantly more complicated and 
requires the coupled vector recursion framework of GD- 
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